Prerequisites

Before using Amazon RDS for MySQL as an endpoint in a Replicate task, make sure the prerequisites outlined below have been met.

Driver prerequisites

Replicate on Windows

Install MySQL ODBC Unicode Driver 64-bit version 8.0.32 on the Replicate machine.

Replicate on Linux

1. Stop the Replicate service:

   ./areplicate stop

2. Optionally, confirm that the service has stopped:

   ./areplicate status
3. Install MySQL ODBC Unicode Driver 64-bit version 8.0.32 on the Replicate machine.

4. Change the working directory to <Replicate-Install-Dir>/bin.

5. Copy the driver location to the site_arep_login.sh file:

   echo "export LD_LIBRARY_PATH=\$LD_LIBRARY_PATH:/usr/lib64" >> site_arep_login.sh

   This will add the driver to "LD_LIBRARY_PATH" and update the driver location in the site_arep_login.sh file.

6. Optionally, confirm that the driver location was copied:

   cat site_arep_login.sh

7. Make sure that the /etc/odbcinst.ini file contains an entry for MySQL, as in the following example:

   [MySQL ODBC 8.0 Unicode Driver]

   Driver = /usr/lib64/libmyodbc8w.so

   UsageCount = 1

8. Start the Replicate service:

   ./areplicate start

9. Optionally confirm that the service has started:

   ./areplicate status

Amazon RDS for MySQL replication

Replication enables data from one Amazon RDS for MySQL database server (the primary server) to be copied to one or more Amazon RDS for MySQL database servers (the secondary servers).

Data can be ingested from either a primary server or a secondary server.

To replicate changes from a secondary server (CDC), the binary logging parameter log_slave_updates needs to be set to true (1).

Setting up Amazon RDS for MySQL for CDC (Change Data Capture)

To set up Amazon RDS for MySQL or Amazon Aurora for MySQL for CDC:

1. Follow the instructions in the AWS Help for creating a new Parameter Group (see the Binary Logging Format section).

2. When creating the new Parameter Group, set: binlog_format=row

3. Save the new Parameter Group.
4. If you have an existing instance of Amazon RDS for MySQL, edit the instance to use the parameter specified in Step 2 above. If you are provisioning a new instance of Amazon RDS for MySQL, reference the new Parameter Group created in Step 1 above.
5. Finally, make sure that automated backup is enabled (the default).

Further reading: https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_LogAccess.MySQL.BinaryFormat.html

Replicating 4-byte UTF8 emojis

Replication of 4-byte UTF8 emojis to certain targets requires the following preparation:

• Microsoft SQL Server Target: Transform the emojis from WSTRING(n) to WSTRING(n*2).
• Amazon Redshift Target: Transform the emojis from WSTRING(n) to WSTRING(n*2).

For information on defining transformations, see Using the Transform tab.